Skip to content

Conversation

@enisdenjo
Copy link
Member

No description provided.

@github-actions
Copy link

💻 Website Preview

The latest changes are available as preview in: https://bd3f2abc.federation-gateway-benchmark.pages.dev

@github-actions
Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1769 110167 total, 0 failed avg: 126ms, p95: 305ms
grafbase 1494 94558 total, 0 failed avg: 147ms, p95: 344ms
cosmo 696 44377 total, 0 failed avg: 316ms, p95: 731ms
hive-gateway-router-runtime 321 21055 total, 0 failed avg: 669ms, p95: 1471ms
hive-gateway 268 18427 total, 0 failed avg: 762ms, p95: 1619ms
apollo-router 248 16623 total, 0 failed avg: 847ms, p95: 2036ms ❌ 77 unexpected GraphQL errors
apollo-gateway 157 10878 total, 0 failed avg: 1205ms, p95: 2637ms
Summary for: hive-router

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 327501      ✗ 0     
     data_received..................: 9.7 GB  155 MB/s
     data_sent......................: 128 MB  2.1 MB/s
     http_req_blocked...............: avg=507.31µs min=1.21µs  med=2.56µs   max=376.48ms p(90)=3.97µs   p(95)=4.73µs   p(99.9)=178.02ms
     http_req_connecting............: avg=502.54µs min=0s      med=0s       max=376.31ms p(90)=0s       p(95)=0s       p(99.9)=177.92ms
     http_req_duration..............: avg=126.38ms min=1.84ms  med=114.58ms max=488.68ms p(90)=257.33ms p(95)=304.94ms p(99.9)=411.14ms
       { expected_response:true }...: avg=126.38ms min=1.84ms  med=114.58ms max=488.68ms p(90)=257.33ms p(95)=304.94ms p(99.9)=411.14ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 110167
     http_req_receiving.............: avg=544.08µs min=22.85µs med=43µs     max=142.27ms p(90)=106.48µs p(95)=403.01µs p(99.9)=79.47ms 
     http_req_sending...............: avg=464.95µs min=5.27µs  med=10.32µs  max=145.65ms p(90)=24.41µs  p(95)=130.45µs p(99.9)=71.38ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=125.37ms min=1.78ms  med=113.72ms max=457.06ms p(90)=255.03ms p(95)=302.73ms p(99.9)=407ms   
     http_reqs......................: 110167  1769.093296/s
     iteration_duration.............: avg=128.35ms min=1.98ms  med=116.17ms max=746.8ms  p(90)=259.65ms p(95)=307.44ms p(99.9)=445.78ms
     iterations.....................: 109167  1753.035009/s
     success_rate...................: 100.00% ✓ 109167      ✗ 0     
     vus............................: 72      min=0         max=494 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: grafbase

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 280674      ✗ 0    
     data_received..................: 8.3 GB  131 MB/s
     data_sent......................: 110 MB  1.7 MB/s
     http_req_blocked...............: avg=725.36µs min=1.3µs   med=3.11µs   max=462.29ms p(90)=4.63µs   p(95)=5.77µs   p(99.9)=229.01ms
     http_req_connecting............: avg=717.67µs min=0s      med=0s       max=451.82ms p(90)=0s       p(95)=0s       p(99.9)=224.47ms
     http_req_duration..............: avg=147.1ms  min=2.52ms  med=135.94ms max=523.15ms p(90)=294.32ms p(95)=343.69ms p(99.9)=438.81ms
       { expected_response:true }...: avg=147.1ms  min=2.52ms  med=135.94ms max=523.15ms p(90)=294.32ms p(95)=343.69ms p(99.9)=438.81ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 94558
     http_req_receiving.............: avg=670.51µs min=24.82µs med=48.19µs  max=304.21ms p(90)=110.65µs p(95)=453.91µs p(99.9)=90.75ms 
     http_req_sending...............: avg=645.23µs min=5.28µs  med=11.89µs  max=154.61ms p(90)=31.49µs  p(95)=146.26µs p(99.9)=94.64ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=145.79ms min=2.47ms  med=134.58ms max=455.62ms p(90)=291.81ms p(95)=341.17ms p(99.9)=433.67ms
     http_reqs......................: 94558   1494.288553/s
     iteration_duration.............: avg=149.83ms min=2.79ms  med=138.05ms max=1.12s    p(90)=297.76ms p(95)=346.83ms p(99.9)=550.83ms
     iterations.....................: 93558   1478.485675/s
     success_rate...................: 100.00% ✓ 93558       ✗ 0    
     vus............................: 73      min=0         max=494
     vus_max........................: 500     min=500       max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: cosmo

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 130131     ✗ 0    
     data_received..................: 3.9 GB  61 MB/s
     data_sent......................: 52 MB   811 kB/s
     http_req_blocked...............: avg=108.6µs  min=1.28µs  med=2.8µs    max=129.51ms p(90)=4.13µs   p(95)=6.19µs   p(99.9)=33.76ms
     http_req_connecting............: avg=102.65µs min=0s      med=0s       max=129.47ms p(90)=0s       p(95)=0s       p(99.9)=33.63ms
     http_req_duration..............: avg=316.42ms min=2.77ms  med=291.15ms max=1.39s    p(90)=640.45ms p(95)=730.59ms p(99.9)=1.18s  
       { expected_response:true }...: avg=316.42ms min=2.77ms  med=291.15ms max=1.39s    p(90)=640.45ms p(95)=730.59ms p(99.9)=1.18s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 44377
     http_req_receiving.............: avg=519.83µs min=26.44µs med=58.26µs  max=190.6ms  p(90)=162.19µs p(95)=443.33µs p(99.9)=109.7ms
     http_req_sending...............: avg=167.1µs  min=5.76µs  med=11.08µs  max=106.66ms p(90)=29.02µs  p(95)=126.02µs p(99.9)=31.29ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=315.73ms min=2.7ms   med=290.37ms max=1.39s    p(90)=639.52ms p(95)=729.38ms p(99.9)=1.18s  
     http_reqs......................: 44377   696.565069/s
     iteration_duration.............: avg=324.24ms min=3.04ms  med=298.89ms max=1.39s    p(90)=644.99ms p(95)=734.1ms  p(99.9)=1.18s  
     iterations.....................: 43377   680.868535/s
     success_rate...................: 100.00% ✓ 43377      ✗ 0    
     vus............................: 95      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: hive-gateway-router-runtime

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 60164      ✗ 0    
     data_received..................: 1.8 GB  28 MB/s
     data_sent......................: 25 MB   376 kB/s
     http_req_blocked...............: avg=146.65µs min=1.33µs  med=3.23µs   max=85.13ms p(90)=5.32µs   p(95)=9.71µs   p(99.9)=36.06ms
     http_req_connecting............: avg=137.33µs min=0s      med=0s       max=85.05ms p(90)=0s       p(95)=0s       p(99.9)=31.03ms
     http_req_duration..............: avg=669.01ms min=4.52ms  med=653.87ms max=2.47s   p(90)=1.32s    p(95)=1.47s    p(99.9)=2.16s  
       { expected_response:true }...: avg=669.01ms min=4.52ms  med=653.87ms max=2.47s   p(90)=1.32s    p(95)=1.47s    p(99.9)=2.16s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 21055
     http_req_receiving.............: avg=155.95µs min=26.82µs med=55.93µs  max=46.04ms p(90)=118.12µs p(95)=302.24µs p(99.9)=15.44ms
     http_req_sending...............: avg=165.36µs min=6.35µs  med=12.88µs  max=63.63ms p(90)=35.69µs  p(95)=133µs    p(99.9)=33.69ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=668.69ms min=4.48ms  med=653.78ms max=2.47s   p(90)=1.32s    p(95)=1.47s    p(99.9)=2.16s  
     http_reqs......................: 21055   321.677832/s
     iteration_duration.............: avg=703.19ms min=4.94ms  med=697.62ms max=2.49s   p(90)=1.34s    p(95)=1.48s    p(99.9)=2.19s  
     iterations.....................: 20054   306.384575/s
     success_rate...................: 100.00% ✓ 20054      ✗ 0    
     vus............................: 87      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: hive-gateway

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52281      ✗ 0    
     data_received..................: 1.6 GB  24 MB/s
     data_sent......................: 22 MB   314 kB/s
     http_req_blocked...............: avg=107.43µs min=1.27µs  med=2.75µs   max=152.41ms p(90)=4.7µs   p(95)=7.48µs   p(99.9)=24.49ms
     http_req_connecting............: avg=101.46µs min=0s      med=0s       max=152.36ms p(90)=0s      p(95)=0s       p(99.9)=24.43ms
     http_req_duration..............: avg=761.66ms min=6.28ms  med=709.8ms  max=4.97s    p(90)=1.47s   p(95)=1.61s    p(99.9)=3.77s  
       { expected_response:true }...: avg=761.66ms min=6.28ms  med=709.8ms  max=4.97s    p(90)=1.47s   p(95)=1.61s    p(99.9)=3.77s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18427
     http_req_receiving.............: avg=144.75µs min=26.31µs med=44.31µs  max=64.5ms   p(90)=94.08µs p(95)=156.03µs p(99.9)=21.73ms
     http_req_sending...............: avg=165.24µs min=5.59µs  med=11.03µs  max=77.06ms  p(90)=30.52µs p(95)=114.73µs p(99.9)=28.14ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=761.35ms min=6.23ms  med=709.66ms max=4.97s    p(90)=1.47s   p(95)=1.61s    p(99.9)=3.77s  
     http_reqs......................: 18427   268.427755/s
     iteration_duration.............: avg=805.73ms min=8.22ms  med=757.45ms max=4.98s    p(90)=1.49s   p(95)=1.62s    p(99.9)=3.83s  
     iterations.....................: 17427   253.860666/s
     success_rate...................: 100.00% ✓ 17427      ✗ 0    
     vus............................: 97      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: apollo-router

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 15546 / ✗ 77
     ✓ valid response structure

     checks.........................: 99.83% ✓ 46792      ✗ 77   
     data_received..................: 1.5 GB 22 MB/s
     data_sent......................: 20 MB  291 kB/s
     http_req_blocked...............: avg=169.45µs min=1.39µs  med=3.44µs   max=192.62ms p(90)=6.29µs   p(95)=13.49µs  p(99.9)=36.46ms
     http_req_connecting............: avg=160.73µs min=0s      med=0s       max=192.55ms p(90)=0s       p(95)=0s       p(99.9)=36.41ms
     http_req_duration..............: avg=846.55ms min=5.8ms   med=795.6ms  max=2.97s    p(90)=1.81s    p(95)=2.03s    p(99.9)=2.72s  
       { expected_response:true }...: avg=846.55ms min=5.8ms   med=795.6ms  max=2.97s    p(90)=1.81s    p(95)=2.03s    p(99.9)=2.72s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 16623
     http_req_receiving.............: avg=172.75µs min=29.07µs med=67.98µs  max=131.68ms p(90)=149.12µs p(95)=362.9µs  p(99.9)=18.67ms
     http_req_sending...............: avg=166.99µs min=7.13µs  med=13.87µs  max=110.36ms p(90)=42.31µs  p(95)=136.15µs p(99.9)=28.38ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=846.21ms min=5.73ms  med=795.2ms  max=2.97s    p(90)=1.81s    p(95)=2.03s    p(99.9)=2.72s  
     http_reqs......................: 16623  248.111127/s
     iteration_duration.............: avg=901.57ms min=6.14ms  med=861.21ms max=2.97s    p(90)=1.83s    p(95)=2.05s    p(99.9)=2.73s  
     iterations.....................: 15623  233.185354/s
     success_rate...................: 99.50% ✓ 15546      ✗ 77   
     vus............................: 65     min=0        max=497
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: apollo-gateway

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29634      ✗ 0    
     data_received..................: 955 MB  14 MB/s
     data_sent......................: 13 MB   188 kB/s
     http_req_blocked...............: avg=31.6µs  min=1.24µs  med=4.11µs  max=24.69ms p(90)=6.6µs    p(95)=13.25µs  p(99.9)=4.62ms
     http_req_connecting............: avg=24.76µs min=0s      med=0s      max=24.62ms p(90)=0s       p(95)=0s       p(99.9)=4.56ms
     http_req_duration..............: avg=1.2s    min=7.47ms  med=1.15s   max=15.17s  p(90)=2.3s     p(95)=2.63s    p(99.9)=13.86s
       { expected_response:true }...: avg=1.2s    min=7.47ms  med=1.15s   max=15.17s  p(90)=2.3s     p(95)=2.63s    p(99.9)=13.86s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10878
     http_req_receiving.............: avg=94.63µs min=27.41µs med=78.57µs max=5.96ms  p(90)=120.77µs p(95)=149.56µs p(99.9)=2.11ms
     http_req_sending...............: avg=44.76µs min=4.87µs  med=16.06µs max=13.71ms p(90)=30.57µs  p(95)=50.92µs  p(99.9)=6.06ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.2s    min=7.39ms  med=1.15s   max=15.17s  p(90)=2.3s     p(95)=2.63s    p(99.9)=13.86s
     http_reqs......................: 10878   157.733505/s
     iteration_duration.............: avg=1.32s   min=8.79ms  med=1.28s   max=15.19s  p(90)=2.36s    p(95)=2.68s    p(99.9)=13.88s
     iterations.....................: 9878    143.233275/s
     success_rate...................: 100.00% ✓ 9878       ✗ 0    
     vus............................: 68      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1690 101854 total, 0 failed avg: 29ms, p95: 51ms
grafbase 1576 95211 total, 0 failed avg: 31ms, p95: 54ms
cosmo 678 41015 total, 0 failed avg: 73ms, p95: 107ms
hive-gateway-router-runtime 318 19358 total, 0 failed avg: 155ms, p95: 199ms
hive-gateway 295 18033 total, 0 failed avg: 166ms, p95: 289ms
apollo-router 252 15329 total, 0 failed avg: 195ms, p95: 247ms
apollo-gateway 126 7730 total, 0 failed avg: 389ms, p95: 457ms
Summary for: hive-router

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 305262      ✗ 0     
     data_received..................: 8.9 GB  148 MB/s
     data_sent......................: 119 MB  2.0 MB/s
     http_req_blocked...............: avg=5.25µs   min=1.19µs  med=2.55µs  max=8.96ms   p(90)=3.68µs   p(95)=4.4µs    p(99.9)=97.05µs
     http_req_connecting............: avg=2.23µs   min=0s      med=0s      max=8.92ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=29.2ms   min=1.91ms  med=26.89ms max=438.75ms p(90)=44.52ms  p(95)=50.65ms  p(99.9)=94.09ms
       { expected_response:true }...: avg=29.2ms   min=1.91ms  med=26.89ms max=438.75ms p(90)=44.52ms  p(95)=50.65ms  p(99.9)=94.09ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 101854
     http_req_receiving.............: avg=122.35µs min=24.98µs med=43.84µs max=352.55ms p(90)=110.16µs p(95)=344.53µs p(99.9)=12.71ms
     http_req_sending...............: avg=97.26µs  min=5.14µs  med=10.3µs  max=390.51ms p(90)=32.05µs  p(95)=125.85µs p(99.9)=13.25ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=28.98ms  min=1.85ms  med=26.72ms max=430.9ms  p(90)=44.15ms  p(95)=50.24ms  p(99.9)=91.7ms 
     http_reqs......................: 101854  1690.092524/s
     iteration_duration.............: avg=29.47ms  min=4ms     med=27.13ms max=461.46ms p(90)=44.77ms  p(95)=50.9ms   p(99.9)=94.88ms
     iterations.....................: 101754  1688.433195/s
     success_rate...................: 100.00% ✓ 101754      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: grafbase

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 285333      ✗ 0    
     data_received..................: 8.4 GB  139 MB/s
     data_sent......................: 111 MB  1.8 MB/s
     http_req_blocked...............: avg=8.92µs   min=1.21µs  med=2.91µs  max=23.13ms  p(90)=4.07µs   p(95)=4.85µs   p(99.9)=112.35µs
     http_req_connecting............: avg=5.42µs   min=0s      med=0s      max=23.1ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=31.22ms  min=2.71ms  med=28.06ms max=458.5ms  p(90)=47.63ms  p(95)=54.16ms  p(99.9)=95.65ms 
       { expected_response:true }...: avg=31.22ms  min=2.71ms  med=28.06ms max=458.5ms  p(90)=47.63ms  p(95)=54.16ms  p(99.9)=95.65ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 95211
     http_req_receiving.............: avg=151.14µs min=27.86µs med=48.02µs max=47.79ms  p(90)=144.06µs p(95)=386.15µs p(99.9)=18.43ms 
     http_req_sending...............: avg=125.21µs min=5.45µs  med=11.66µs max=307.15ms p(90)=38.05µs  p(95)=136.25µs p(99.9)=17.22ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=30.94ms  min=2.64ms  med=27.86ms max=449.52ms p(90)=47.13ms  p(95)=53.63ms  p(99.9)=92.18ms 
     http_reqs......................: 95211   1576.738369/s
     iteration_duration.............: avg=31.53ms  min=4.51ms  med=28.35ms max=492.17ms p(90)=47.92ms  p(95)=54.46ms  p(99.9)=97.07ms 
     iterations.....................: 95111   1575.082323/s
     success_rate...................: 100.00% ✓ 95111       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: cosmo

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 122745     ✗ 0    
     data_received..................: 3.6 GB  60 MB/s
     data_sent......................: 48 MB   789 kB/s
     http_req_blocked...............: avg=17.53µs  min=1.33µs  med=2.88µs  max=18.59ms  p(90)=4.02µs   p(95)=4.91µs   p(99.9)=8ms     
     http_req_connecting............: avg=13.83µs  min=0s      med=0s      max=18.56ms  p(90)=0s       p(95)=0s       p(99.9)=7.44ms  
     http_req_duration..............: avg=72.86ms  min=2.91ms  med=71.82ms max=511.47ms p(90)=98.61ms  p(95)=106.6ms  p(99.9)=286.85ms
       { expected_response:true }...: avg=72.86ms  min=2.91ms  med=71.82ms max=511.47ms p(90)=98.61ms  p(95)=106.6ms  p(99.9)=286.85ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 41015
     http_req_receiving.............: avg=170.03µs min=29.37µs med=71.09µs max=301.1ms  p(90)=145.55µs p(95)=384.3µs  p(99.9)=15.7ms  
     http_req_sending...............: avg=62.53µs  min=5.62µs  med=11.2µs  max=339ms    p(90)=29.95µs  p(95)=124.44µs p(99.9)=6.06ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=72.63ms  min=2.83ms  med=71.6ms  max=489.55ms p(90)=98.37ms  p(95)=106.32ms p(99.9)=279.35ms
     http_reqs......................: 41015   678.537718/s
     iteration_duration.............: avg=73.35ms  min=6.7ms   med=72.15ms max=564.61ms p(90)=98.92ms  p(95)=106.93ms p(99.9)=301.47ms
     iterations.....................: 40915   676.883353/s
     success_rate...................: 100.00% ✓ 40915      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: hive-gateway-router-runtime

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 57774      ✗ 0    
     data_received..................: 1.7 GB  28 MB/s
     data_sent......................: 23 MB   371 kB/s
     http_req_blocked...............: avg=42.31µs  min=1.49µs  med=3.92µs   max=20.57ms  p(90)=5.78µs   p(95)=6.65µs   p(99.9)=15.71ms 
     http_req_connecting............: avg=37.11µs  min=0s      med=0s       max=20.51ms  p(90)=0s       p(95)=0s       p(99.9)=15.65ms 
     http_req_duration..............: avg=154.63ms min=4.82ms  med=151.06ms max=625.81ms p(90)=187.03ms p(95)=199.4ms  p(99.9)=448.26ms
       { expected_response:true }...: avg=154.63ms min=4.82ms  med=151.06ms max=625.81ms p(90)=187.03ms p(95)=199.4ms  p(99.9)=448.26ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 19358
     http_req_receiving.............: avg=104.77µs min=35.24µs med=70.03µs  max=273.73ms p(90)=121.01µs p(95)=151.68µs p(99.9)=2.2ms   
     http_req_sending...............: avg=94.84µs  min=7.47µs  med=15.38µs  max=416.62ms p(90)=26.97µs  p(95)=44.98µs  p(99.9)=3.71ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=154.43ms min=4.72ms  med=150.92ms max=611.54ms p(90)=186.91ms p(95)=199.19ms p(99.9)=429.25ms
     http_reqs......................: 19358   318.961295/s
     iteration_duration.............: avg=155.86ms min=35.88ms med=151.58ms max=665.24ms p(90)=187.49ms p(95)=199.93ms p(99.9)=513.52ms
     iterations.....................: 19258   317.313598/s
     success_rate...................: 100.00% ✓ 19258      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: hive-gateway

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53799      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   344 kB/s
     http_req_blocked...............: avg=54.19µs  min=1.26µs  med=2.76µs   max=185.18ms p(90)=4.63µs   p(95)=5.92µs   p(99.9)=16.11ms
     http_req_connecting............: avg=39.81µs  min=0s      med=0s       max=20.35ms  p(90)=0s       p(95)=0s       p(99.9)=15.7ms 
     http_req_duration..............: avg=165.99ms min=7.07ms  med=149.8ms  max=1.46s    p(90)=181.02ms p(95)=289.04ms p(99.9)=1.45s  
       { expected_response:true }...: avg=165.99ms min=7.07ms  med=149.8ms  max=1.46s    p(90)=181.02ms p(95)=289.04ms p(99.9)=1.45s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18033
     http_req_receiving.............: avg=99.67µs  min=26.09µs med=53.56µs  max=19.86ms  p(90)=120.35µs p(95)=235.66µs p(99.9)=4.42ms 
     http_req_sending...............: avg=95.02µs  min=5.38µs  med=11.26µs  max=439.98ms p(90)=33.15µs  p(95)=127.89µs p(99.9)=4.52ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=165.79ms min=6.98ms  med=149.64ms max=1.46s    p(90)=180.83ms p(95)=286.21ms p(99.9)=1.45s  
     http_reqs......................: 18033   295.83755/s
     iteration_duration.............: avg=167.38ms min=37.87ms med=150.24ms max=1.46s    p(90)=181.64ms p(95)=298.65ms p(99.9)=1.45s  
     iterations.....................: 17933   294.197015/s
     success_rate...................: 100.00% ✓ 17933      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: apollo-router

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 45687      ✗ 0    
     data_received..................: 1.3 GB  22 MB/s
     data_sent......................: 18 MB   293 kB/s
     http_req_blocked...............: avg=46.24µs  min=1.86µs  med=3.25µs   max=18.18ms  p(90)=4.82µs   p(95)=5.61µs   p(99.9)=14.58ms 
     http_req_connecting............: avg=41.61µs  min=0s      med=0s       max=18.02ms  p(90)=0s       p(95)=0s       p(99.9)=14.56ms 
     http_req_duration..............: avg=195.45ms min=5.56ms  med=195.66ms max=619.05ms p(90)=235.45ms p(95)=247.43ms p(99.9)=472.66ms
       { expected_response:true }...: avg=195.45ms min=5.56ms  med=195.66ms max=619.05ms p(90)=235.45ms p(95)=247.43ms p(99.9)=472.66ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 15329
     http_req_receiving.............: avg=122.36µs min=38.04µs med=64.21µs  max=304.51ms p(90)=113.73µs p(95)=140.52µs p(99.9)=1.92ms  
     http_req_sending...............: avg=93.34µs  min=7.56µs  med=12.96µs  max=256.02ms p(90)=22.16µs  p(95)=37.57µs  p(99.9)=5.33ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=195.23ms min=5.51ms  med=195.56ms max=586.21ms p(90)=235.27ms p(95)=247.11ms p(99.9)=463.37ms
     http_reqs......................: 15329   252.245918/s
     iteration_duration.............: avg=197.17ms min=56.65ms med=196.19ms max=643.77ms p(90)=235.96ms p(95)=247.93ms p(99.9)=524.57ms
     iterations.....................: 15229   250.600371/s
     success_rate...................: 100.00% ✓ 15229      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: apollo-gateway

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 22890      ✗ 0   
     data_received..................: 679 MB  11 MB/s
     data_sent......................: 9.0 MB  147 kB/s
     http_req_blocked...............: avg=31.55µs  min=1.2µs   med=2.92µs   max=9.1ms    p(90)=4.77µs   p(95)=5.61µs   p(99.9)=7.43ms  
     http_req_connecting............: avg=28.2µs   min=0s      med=0s       max=9.07ms   p(90)=0s       p(95)=0s       p(99.9)=7.4ms   
     http_req_duration..............: avg=388.54ms min=7.09ms  med=388.36ms max=793.57ms p(90)=441.55ms p(95)=457.38ms p(99.9)=744.59ms
       { expected_response:true }...: avg=388.54ms min=7.09ms  med=388.36ms max=793.57ms p(90)=441.55ms p(95)=457.38ms p(99.9)=744.59ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7730
     http_req_receiving.............: avg=64.71µs  min=27.94µs med=54.86µs  max=10.54ms  p(90)=90.57µs  p(95)=101.84µs p(99.9)=642.42µs
     http_req_sending...............: avg=148.9µs  min=5.29µs  med=11.43µs  max=174ms    p(90)=18.47µs  p(95)=22.32µs  p(99.9)=49.24ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=388.33ms min=7.03ms  med=388.29ms max=792.88ms p(90)=441.47ms p(95)=457.14ms p(99.9)=743.9ms 
     http_reqs......................: 7730    126.589726/s
     iteration_duration.............: avg=393.97ms min=72.63ms med=388.93ms max=823.71ms p(90)=442.2ms  p(95)=458ms    p(99.9)=764.77ms
     iterations.....................: 7630    124.952084/s
     success_rate...................: 100.00% ✓ 7630       ✗ 0   
     vus............................: 22      min=22       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant